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ABSTRACT 



The Continuous School Improvement Questionnaire (CSIQ) is a 
comprehensive inventory measuring educators' perceptions of factors that 
affect success with school improvement. A pilot test of the CSIQ was 
conducted in Spring 2000, one purpose of which was to reduce the length of 
the CSIQ. The instrument was reduced from 147 to 72 items. The pilot test was 
based on data from 274 educators, but the extensive field test reported in 
this monograph gathered data from 2,093 educators, primarily teachers, from 
79 schools. The numbers of scores for subscales and the total scale varied, 
but in all cases they were less than 2,093. Pilot test results indicate that 
the 72 -item CSIQ is highly reliable, both the total inventory and the 
individual subscales. For about 3 weeks, the CSIQ has moderate to high 
stability reliability. Mean scores on the CSIQ subscales are highly 
consistent and positioned about 70% of the distance from the minimum to the 
maximum scores. The type (level) of school appears to have a slight to modest 
effect on subscale and total score performance, with subjects in elementary 
school having the greater performance. Females tend to score higher than 
males, but the effect is at least partially confounded with type of school. 
Subjects in schools known to be in a mode of continuous improvement score 
higher on subscales and total score than their counterparts in the same type 
of schools. When considering continuous school improvement as a concept 
measured by the CSIQ, there appear to be six underlying constructs, which 
closely coincide with the six subscales of the CSIQ. (Contains a 21 
references.) (SLD) 
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INTRODUCTION 



The Continuous School Improvement Questionnaire (CSIQ) is a comprehensive 
inventory measuring educators’ perceptions of factors that affect success with school 
improvement. A pilot test of the CSIQ was conducted in Spring 2000 (Wiersma, 2000), one 
purpose of which was to reduce the length of the CSIQ. This was done, and the CSIQ was 
reduced from 147 to 72 items, 12 items for each of the 6 subscales. Reducing the number of 
items did not affect adversely the internal consistency reliability of the subscales or the total 
score. These reliability estimates were consistently high with the lowest coefficient of .89 for 
one of the subscales. 

The pilot test was based on data from 274 educators, whereas the extensive field test 
gathered data from 2,093 educators, primarily teachers, who will be referred to as the subjects of 
the field test. Data were collected in the Fall of 2000 from faculty members in 79 schools. In 
general, a field test following a pilot test is completed to establish the instrument and to 
investigate performances on the instrument as related to variables that exist in the natural, 
educational setting. The purposes of the field test were 

1. to determine the status of performance on the CSIQ, its subscales and total score, for a 
large base of subjects 

2. to investigate possible differences in performance by type of school for the subjects 

3. to check the consistency of reliability estimates for the subscales and total scores with 
estimates established by the pilot test data 

4. to determine the relationships among the CSIQ subscale scores and total score, and 
their relationships to scores on the School Climate Questionnaire (SCQ), an inventory 
about perceptions of the school, many of which at least on face value appear to be 
related to school improvement 



5. to obtain an estimate of stability reliability for the CSIQ from a test-retest of a subset 
of the subjects 

6. to investigate as appropriate the effects of any other variables upon the CSIQ scores 



The CSIQ has six subscales, appropriately named, reflecting the content of the subscale 

items. The subscales are listed below and, to facilitate their identification in the report and its 

tables, they are designated by assigned subscripts. 

S,: Learning Culture 

S 2 : Community of Learners 

S 3 : Sharing Leadership 

S 4 : Shared Goals for Learning 

S 5 : Assessing Student Learning 

S 6 : Enabling the SMART 1 Learner 

The items of the CSIQ are 6-point rating scale items. The response options range from 1 
being “Is not present” to 6, “Is present to a high degree.” The higher the response, the greater the 
score. Scores are generated across the items of the subscales and then totaled. Thus, subscale 
scores may range from 12 to 72, and the total score may range from 72 to 432. 



'SMART is the acronym for Successful, Motivated, Autonomous, Responsible, and 
Thoughtful, and was one of the major elements of Quest, a four-year R&D project at AEL, Inc 
(AEL, 1995 & 1998). A large number of publications from the Quest project have been 
published by AEL, including 1 2 evaluation reports, three research reports, a case study of one 
popular Quest process, four summative school case studies, and a final lessons learned report. 
See the Bibliography for the citations for these Quest publications. 



RESULTS ACROSS ALL SUBJECTS 



CSIQ scores on 2,093 subjects provide an extremely large database for a field test. This, 
along with the type of inventory used to measure the school improvement variables, imposes 
certain characteristics on the database. Subjects will on occasion omit items, for such possible 
reasons as being unsure about a response and failing to return to the item. In order to compute 
total scores and to estimate internal consistency reliability, there must be responses to all items of 
a subscale or total scale. As a result, the numbers of scores for subscales and the total scale 
varied, but in all cases they were less than 2,093. As expected, the total scale had the fewest 
number of scores. 

Subjects were generally coded according to type of school (elementary, middle, or high 
school). However, four schools did not fit the typical definitions of elementary, middle, or high 
school: K-12, PK-12, 6-12, and 9 th grade only. Throughout this report, these schools are 
designated “other.” For whatever reason, some schools wanted to remain anonymous and were 
unidentifiable as to type. Scores for subjects from these schools could be included in the overall 
analysis, but they could not be included in any analysis requiring type of school identification. 

Four schools were identified as being in a continuously improving mode, thus they were 
designated as “known” schools. These schools reflected the six major components of Quest and 
their inclusion allowed comparisons with schools of their types. The “known” schools included 
three elementary and one private (Catholic) high school. 

With the large number of scores, statistics generated were very stable; i.e., standard errors 
were very small. This field test does not meet all criteria for using inferential statistics in a 



